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The  research  project  described  herein  deals  with  the  capability 
of  training  a  human  subject  to  control  and/or  interact  with  complex 
electronic  or  mechanical  systems.  Basically  the  projec*-  involves 
the  detection  of  bioelectrical  phenomena  that  are  analogs  of  ongoing 
cognitive  processes  and  the  utilization  of  these  phenomena  to  control 
external  events.  The  project  also  allows  the  system  being  controlled 
to  communicate  with  the  human  operator  in  either  a  feedback  or  an 
interactive  manner.  In  bypassing  the  subject's  manual  or  verbal  respons 
apparatus  an  appreciable  time  saving  is  achieved.  By  eliminating  the 
normal  feedback/interactive  modes  of  communication  currently  employed 
by  machines  (generally  visual  signals  produced  mechanically  or  electron¬ 
ically)  a  further  potential  time  saving  is  realized.  However,  the  major 
advantage  of  the  proposal  is  the  virtually  automatic  control  of  systems 
operation  by  the  trained  subject. 


Introduction 

We  are  training  subjects  to  respond  to  alpha-numeric  symbols  such 
that  a  discriminable  response  will  be  obtained  to  each  symbol.  The 
sunbols  are  a  truncated  set  of  the  English  alphabet.  The  response  is 
tie  electromyogram  (EMG)  recorded  from  the  surface  of  the  skin  overlying 
muscle.  The  EMG  is  most  directly  an  index  of  motor  nerve  activity  rather 
than  of  muscle  activity  level  since  the  magnitude  of  the  electrical 
response  is  a  direct  function  of  the  amount  of  neural  activity  imposed 
upon  the  individual  motor  units  of  skeletal  muscle.  The  EMG  is  always 
present  upn  sufficient  neural  activity  to  elicit  muscle  movement  and 
is  also  detectable  given  neural  activity  insufficient  to  generate 
movement.  Interestingly,  when  a  subject  is  instructed  to  "think  about" 
flexing  a  specific  muscle,  a  recording  of  the  EMG  accompanying  this 
cognitive  process  is  possible.  In  short,  the  EMG  has  the  unusual 
property  of  being  activated  by  the  mere  thought  of  activating  the 
response  system,  e.g.,  the  muse l*  (Leuba  &  Dunlap,  1951).  This  property 
of  the  EMG  has  been  known  for  years  (Hefferline  &  Perera,  1958)  and 
has  been  utilized  in  several  applied  bioengineering  situations,  most 
notably  the  control  of  prosthetic  devices.  In  this  case,  the  subject, 
with  sufficient  training,  becomes  quite  adept  at  controlling  his 
prosthetic  device  and  reaches  the  point  where  he  need  not  actively 
conceptualize  a  muscle  movement  to  produce  the  EMG  signals  necessary 
to  control  the  limb  and  reach  his  goal,  but  merely  "thinks"  of  the 
desired  movement  to  be  performed.  The  thought  of  the  movement  is 
sufficient  to  produce  the  necessary  EMG ' s .  Later  in  his  training 
he  need  not  even  think  of  the  movements  necessary  to  reach  the  goal, 
but  merely  thinks  o  the  goal  with  the  same  lack  of  direct,  conscious 
c ommands  as  does  an  intact  human.  It  follows,  of  course,  that  the 
muscles  used  to  control  the  limb  cannot  be  occupied  with  other  tasks 
that  would  produce  error  commands. 

Our  project  deals  with  the  capability  of  training  a  human  subject 
to  control  and/or  interact  with  complex  electronic  or  mechanical 
systems.  Basically  the  project  involves  the  detection  of  bioelectrical 
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phenomena  that  are  analogs  of  ongoing  cognitive  processes  and  the 
utilization  of  these  phenomena  to  control  external  events.  The 
project  also  allows  the  system  being  controlled  to  communicate  with 
the  human  operator  in  either  a  feedback  or  an  interactive  manner. 

In  bypassing  the  subject's  manual  or  verbal  response  apparatus  an 
appreciable  time  saving  is  achieved.  By  eliminating  the  normal 
feedback/interactive  modes  of  communication  currently  employed  by 
machines  (generally  visual  signals  produced  mechanically  or  electron¬ 
ically)  a  further  potential  time  saving  is  realized. 

The  first  year  objectives  were  twofold:  1)  to  develop  the  inter¬ 
active  systems  hardware  and  software,  and  2)  to  train  subjects  to 
generate  and  respond  correctly  to  alpha-numeric  symbols  using  EMG 
responses.  The  first  annual  progress  report  detailed  these  accomplish¬ 
ments  . 

A  central  instrument  in  the  conduct  of  this  project  is  the 
augmented  PDP-12  computer  configuration.  Since  we  have  completed 
the  transition  from  off-line  logic  control  to  on-line  control  and 
analysis,  we  are  now  in  a  position  from  the  computational  point  of 
view  *-o  be  able  to  acquire  up  to  24  simultaneous  EMG  and  EEG  records 
as  necessary  to  support  the  various  tasks.  This  acquisition  capability 
in  conjunction  with  the  data  storage  and  computational  capability  ir. 
the  form  of  the  disc  facility  and  the  floating  point  processor  provide 
a  highly  flexible  tool  for  use  in  the  accomplishment  of  the  defined 
task  sequences. 

The  software  which  was  developed  before  delivery  of  the  addon 
equipment  was  oriented  toward  the  control  of  the  training  program. 

We  are  currently  expanding  these  software  sets  to  utilize  the  full 
capabilities  of  the  system. 

Subjects  have  been  trained  to  generate  16  different  muscle 
patterns  on  cue.  The  process  of  training  subjects  to  generate  these 
precisely  defined  motor  responses  to  visual  stimuli  proceeds  from  a 
simple  match-to-sample  task  to  the  codification  of  a  truncated 
alphabet  by  these  defined  sets  of  responses.  The  responses  currently 
being  directly  trained  are  the  electromyographic  (EMG)  records  from 
the  skin  surface  overlying  four  muscles: 

Left  and  right  flexor  pollicis  brevis  (thumbs), 

Left  and  right  obductor  digiti  minimi  (little  fingers). 

Subjects  are  required  to  generate  these  EMG  responses  without  ap¬ 
preciable  movements  of  the  muscles  or  fingers.  This  3spect  of  the  task  -- 
generating  the  EMG's  --  has  proved  easy  for  subjects  and  surprisingly 
"enjoyable"  for  them.  They  report  that  it  is  "fun"  to  do  it  with  the 
attendant  compjter  biofeedback.  We  have  emphasized  use  of  immediate  visual 
feedback  in  training  to  date.  It  is  in  fact  remarkable  how  quickly  un¬ 
trained  subjects  can  learn  the  task.  We  were  pleasantly  surprised 
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that  training  naive  subjects  proceeds  so  fast.  We  have  a  strong  impression 
that  the  manual  capabilities  of  man,  utilized  in  terms  of  EMG  activity 
rather  than  substantial  movements,  far  exceed  expectations  based  on  current 
manual  task  requirements. 


Current  Project  Status 

The  funding  support  upon  which  this  project  is  predicated  was  not 
received  until  May,  1973.  During  the  five  months  between  the  starting 
date  of  the  second  year  and  the  receipt  of  funds,  the  University  of 
California  at  Irvine  loaned  us  a  small  sum  of  money  which  allowed  us 
to  continue  the  project  at  a  minimal  support  level.  The  restricted 
support  necessitated  the  selection  of  a  subset  of  the  second  year's 
goals  to  be  pursued.  Consequently  the  major  effort  during  the  past 
six  months  has  been  directed  to  two  projects.  The  first  was  a  study 
of  the  significance  of  biological  feedback  in  performance  acquisition. 
Secondly,  effort  was  directed  toward  developing  computer  programs  capable 
of  handling  the  segmentation  problem  associated  with  a  subject's  generating 
multiple  sequential  characters. 

I.  Biofeedback 

This  study  employed  two  groups,  one  with  maximal  feedback  (i.e., 
visual,  auditory  and  reinforcement  signals);  the  second  with  only 
reinforcement  signals  denoting  successful  matching  of  the  R  code  to 
the  S  code.  A  replication  currently  in  progress,  will  assess  the 
relative  contribution  made  by  auditory  ana  visual  feedback  in  acquisition 
of  a  performance.  It  is  clear  that  this  feedback  enhances  problem  solving 
ut  a  distinction  must  be  made  between  problem  solving  and  performance 
acquisition.  The  intent  here  is  to  validate  training  procedures  aimed 
at  improving  performance. 

General  Procedures.  Subjects  were  trained  to  generate  16  different 
muscle  patterns  on  cue.  The  process  of  training  subjects  tc  generate 
these  precisely  defined  motor  responses  to  visual  stimuli  proceeded  from 
a  simple  match-to  sample  task  to  the  codification  of  a  truncated  alphabet 
by  use  of  these  defined  sets  of  responses.  The  responses  trained  were 
the  eiectromyograpnic  (EMG)  records  from  the  skin  surface  overlying 
four  muscles: 


Left  and  right  flexor  pollicis  brevis  (thumbs), 

Left  and  right  obductor  digiti  minimi  (little  fingers). 

Subjects  were  required  to  generate  these  EMG  responses  without 
appreciable  movements  of  the  muscles  or  fingers.  The  four  muscles 
permit  16  combinations  of  response/no  response  patterns.  Testing  and 
training  took  place  in  a  sound-attenuating,  ventilated  chamber  which 
was  dimly  lit  (see  Figure  1).  The  subjects  sat  in  a  comfortable, 
stu  fed  chair  and  were  not  required  to  utilize  any  of  their  mu-culature 
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to  remain  in  a  comfortable  position.  Subjects  faced  a  window  in  the 
room  through  which  they  saw  the  lamp  display  and  alphanumeric  display 
devices  (to  be  described  later).  A  black  cloth  around  these  units 
reduced  distracting  visual  stimuli  to  a  minimum.  The  EMG  was  recorded 
using  gold  disc  electrodes  and  electrode  paste  and  'eld  on  with  tape. 

Patterned  Light  Training.  Each  of  the  16  EMG  combinations  was 
assigned  a  particular  alphanumeric  code  (see  Appendix  A).  These  codes 
can  be  considered  as  four  lamps  which  can  be  lit  or  dark  in  various 
combinations.  Thus,  to  train  subjects  we  employed  a  lamp  display 
panel  (see  Figure  2).  The  display  consists  of  two  rows  of  incandescent 
lamps.  Lamps  in  the  top  row  have  orange  lenses,  the  lamps  on  the 
bottom  are  green  and  the  single  lamps  on  the  extreme  right  and  left 
are  red. 

Rather  than  initially  prerent  the  alphanumeric  display  and  the 
associated  code  as  displayed  on  the  lamp  display  we  first  trained  the 
subjects  to  respond  to  the  lamps  alone.  It  was  felt  that  this  was  a 
somewhat  simpler  task  and  that  the  alphanumeric  display  training  would 
represent  the  second  phase  of  the  study.  The  task  consisted  of  the 
presentation  of  a  pattern  of  lit  lamps  or.  the  upper  row.  The  upper 
row  of  lamps  for  convenience  are  referred  to  as  the  S  code  (Stimulus 
Code)  lamps.  The  subject  was  to  turn  on  the  lower  row  of  lamps  such 
that  the  pattern  of  lit  lamps  in  the  two  rows  coincided.  The  lower 
row  of  lamps  will  be  referred  to  as  the  R  Code  (Response  Code)  lamps. 

Thus,  the  task  is  a  match-to-sample  paradigm. 

Every  6-10  seconds  the  S  Code  was  displayed  for  1.5  seconds.  At 
the  same  time  the  left  hand  red  lamp  was  lit  signalling  the  start  of 
a  trial  (termed  the  GO  lamp).  The  subject  then  issued  a  response.  If 
successful  in  matching  to  the  sample  the  right  hand  red  light  was  lit 
( r e i n f o r c eme_nt  lamp).  At  the  end  of  the  trial  the  lamp  display  panel 
was  turned  off. 

Response  Recording  and  Encoding.  The  previously  described  muscles 
were  mapped  on  the  surface  of  the  ove-lyim  skin  to  determine  the  location 
yielding  the  best  signal  to  noise  level.  Using  differential  amplification 
the  most  satisfactory  results  were  obtained  by  placing  the  active 
electrode  over  the  belly  of  the  muscle  and  thr  indifferent  over  the 
distal  tendon.  All  recording  configurations  employed  earlobe  grounding. 
Amplifier  gain  was  from  30-150  V/cm.  (Grass  polygraph--EEG  channel) 
with  a  bandpass  of  1  to  75  Hz.  The  four  channels  of  EMG  information 
were  amplified  and  simultaneously  written  onto  a  pen-writing  polygraph. 

The  amplified  EMG  was  fed  to  a  series  of  voltage  comparators  which 
produced  a  standard  logic  level  pulse  when  the  voltage  of  the  EMG 
exceeded  a  selected  level.  The  PDP-12  computer's  external  sense  lines 
then  permitted  decoding  of  the  logic  level  R  Codes  unde-,  software 
control.  As  a  function  of  the  detected  R  Code  and  at  the  experimenter's 
option  the  computer  1)  activated  the  R  Code  lamps  for  patterned  visual 
feedback;  2)  activated  audio  oscillators  which  are  spatially  arranged 
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for  auditory  feedback;  or  3)  displayed  the  R  Code  alphabetic  character 
on  the  alphanumeric  display  unit  as  a  form  of  cognitive  feedback. 

The  S  Code  presented  on  any  trial  was  randomly  determined  by  a 
high-speed  digital  clock  that  transferred  its  count  to  the  S  Code  flip- 
flops  upon  command  from  a  timor.  The  flip-flops  in  turn  activated  the 
lamp  drivers  and  5  Code  lamp.,  of  the  display  panel.  The  computer 
interpreted  the  S  Code  and  monitored  the  sense  lines  for  the  subject's 
R  Code.  While  monitoring  and  matching  the  R  Code  to  the  S  Code,  the 
computer  constantly  updated  the  feedback  options  with  the  current  R 
Code  responses.  When  a  match  was  detected  between  the  S  Code  and  R  Code  ’ 
the  computer  signaled  a  reinforcement.  This  program  provided  a  letter 
by  letter  analvsis  for  each  trial  consisting  of  an  indication  of  the 
S  Code,  the  subject's  response,  and  the  latency  for  each  muscle  group 
in  mi 1 liseconds . 

The  paradigm  followed  consisted  of  four  consecutive  daily  sessions 
with  256  trials  of  patterned  light  training  and  then  four  more  consecutive 
daily  sessions  with  256  trials  of  alphabetic  training  with  no  patterned 
lights,  either  S  or  R  Codes.  Between  the  patterned  light  and  letter 
training,  the  subjects  were  given  the  alphanumerics  and  their  codes  to 
learn.  Appendix  B  has  the  instructions  which  the  subjects  read  prior 
to  the  first  session.  While  being  presented  the  S  codes,  one  group  of 
eight  subjects  (feedback)  received  tne  following  feedback  modes  informing 
them  of  the  specific  EMG's  generated: 

1)  R  Code  lamp  illumination; 

2)  Audible  tones,  spacially  arranged  relative  to  the 
EMG's  involved; 

3)  A  reinforcement  lamp  illumination  when  the  R  Code 
matched  the  S  Code. 

fhe  second  group  of  subjects  (non-feedback)  received  only  the 
reinforcement  lamp  illumination  to  inform  them  of  the  correctness  of 
their  EMG  generations. 

Results.  The  data  obtained  from  the  two  groups  of  biofeedback  subjects 
was  subjected  to  an  error  analysis.  The  error  analyses  were  of  two  types, 
referred  to  as  Measure  A  and  Measure  B,  both  of  which  express  a  conditional 
probability  of  error.  Method  A  is  that  given  an  error  has  occurred,  what 
are  the  probabilities  of  eliciting  an  error  by  each  of  the  stimulus  codes. 
The  measure  is  thus  the  intersection  of  the  overall  probability  of  error 
and  the  individual  stimulus  eliciting  the  error.  A  large  number  indicates 
a  higher  propensity  to  issue  incorrect  responses  to  that  particular 
stimulus.  The  data  from  the  feedback  (F)  and  non-feedback  (NF)  groups 
are  analysed  by  Method  A  for  each  alphanumeric  character  as  a  function 
of  type  of  training  (Light  Training  and  Letter  Training)  as  a  function 
days.  Column  probability  of  error  scores  [P(e)]  are  included  to  assess 
improvement  wi„h  practice. 
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Table  1  presents  the  results  of  Measure  A  to  the  respective  alpha- 
nume.'ics.  The  left  hand  column  of  Table  1  lists  the  associated  binary 
codes.  These  binary  codes  can  be  related  to  EMG  activation  of  particular 
musculature  by  referring  to  Table  2.  An  inspection  of  the  daily  error 
scores  [P(c)J  within  a  treatment  condition  across  days  shows  that  a 
significant  improvement  occurred  across  days  within  each  treatment. 

This  data  has  been  graphically  presented  in  Figure  3.  From  this  figure 
it  is  apparent  that  in  addition  to  an  effect  of  days  there  Is  an  effect 
of  feedback.  The  feedback  group  both  starts  at  a  lower  error  level 
and  improves  to  a  final  level  which  is  superior  to  the  non-feedback 
group.  It  is  clear  that  the  presence  of  feedback  in  this  task  clearly 
improves  acquisition  performance. 

It  is  of  considerable  interest  to  note  that  the  data  plotted  for 
the  light  training  and  letter  training  is  a  repeated  measure  on  the 
same  groups  of  subjects.  The  day  one  error  scores  are  similar  for  the 
letter  training  phase  and  the  light  training  phase  oi  the  experiment. 

The  end  training  values  on  days  4  are  also  similar.  This  observation 
suggests  that  skills  learned  under  light  training  have  little  transfer 
value  to  letter  training.  An  alternative  interpretation  is  that  without 
the  initial  light  training  the  letter  training  learning  curves  would 
show  a  greater  number  of  initial  errors.  We  cannot  rule  this  possibility 
out  as  it  was  not  specifically  tested.  However,  it  appears  that  the 
initial  assumptions  regarding  training  protocols  in  this  project  wherein 
we  assumed  that  there  would  be  considerable  transfer  from  patterned 
light  training  to  letter  training  may  be  in  error.  It  now  seems 
reasonable  to  consider  bypassing  the  initial  patterned  light  training 
which  would  result  in  an  appreciable  reduction  in  training  time. 

The  data  of  Table  1  were  ranked  from  stimuli  eliciting  the  least 
errors  to  stimuli  eliciting  the  most  errors  for  each  treatment  condition 
across  days.  Table  3  presents  the  ranking  of  conditional  probability 
of  error  for  light  training  and  Table  4  presents  the  rankings  for 
letter  training.  It  can  be  seen  that  the  relative  positions  of  the 
light  patterns/letters  remain  generally  stable  across  days.  The  overall 
number  of  errors  drops  as  a  function  of  practice  but  the  relative 
distribution  of  error  eliciting  stimuli  remains  generally  fixed.  ’hus , 
these  data  were  collapsed  across  days  into  the  data  of  Table  5  which 
gives  the  mean  rankings  over  days. 

From  Table  5  it  can  be  seen  that  those  stimuli  eliciting  the  least 
errors  are  characterized  by  a  relatively  sample  response  configuration. 
The  binary  codes  0000  and  1111  are  uniformly  superior  to  more  complicated 
patterns.  On  the  other  hand,  the  stimuli  eliciting  the  most  errors  are 
those  codes  requiring  a  complex  bilateral  response,  for  example  1101. 
There  are  several  interesting  inconsistencies  in  the  error-response 
patterns  whose  explanation  is  not  immediately  apparent.  These  are 
typified  by  the  codes  0011(S)  and  0001(1).  These  data  are  of  interest 
both  theoretically  in  relation  to  cerebral  dominance  and  interaction 
and  practically  in  that  they  identify  "error  prone"  stimuli.  We  now 
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can  proceed  to  restructure  tne  alphanumeric  code  assignments  to  minimize 
error  signals  to  high  probability  alphanumer ics .  For  example,  the 
letter  "E",  which  is  the  most  frequently  appearing  letter  in  English 
usage  occupies  an  error  position  halfway  down  the  range.  We  propose  to 
structure  the  new  code  assignments  such  that  they  will  be  at  the 
intersection  of  the  1)  letter  frequency,  2)  information  content  of 
the  letter,  and  3)  the  "error  quotient"  of  the  code.  By  using  such  an 
approach  we  can  reduce  the  deleterious  efftcts  of  error  signals  to  a 
minimal  and  acceptable  level. 

The  second  type  of  error  analysis  performed  on  this  data  (Method  B) 
expresses  the  conditional  probability  of  an  error  type.  Given  that 
an  error  has  occurred  to  any  stimulus,  what  are  the  probabilities  of 
the  type  of  error  in  terms  of  the  alphanumeric  code.  A  large  number 
indicates  a  higher  propensity  to  produce  an  error  having  this  particular 
code.  In  other  words,  when  an  error  occurs  what  pattern  does  it  have. 

Table  6  presents  the  results  of  considering  the  error  types  for  all 
treatments  across  days.  The  column  error  percentages  are  the  same  as 
those  indicated  in  Table  1  as  the  data  are  identical,  only  the  method 
of  analysis  differs.  A  cursory  inspection  of  Table  6  indicates  that 
by  far  the  most  common  error  is  to  activate  all  the  EMG  channels, 
1111(D).  For  ease  of  interpretation  these  data  are  expressed  in  a 
ranking  in  Table  7  (Light  Training)  and  Table  8  (Letter  Training). 

The  relative  rauking  positions  of  error  type  can  be  seen  to  change  in 
a  complex  manner  as  a  function  of  training.  An  overall  condensation 
of  the  duta  is  presented  in  Figure  9  showing  the  error  ranking  across 
days.  The  most  common  error  signal  is  an  activation  of  all  EMG  channels 
These  data  will  be  utilized  in  the  construction  of  the  new  EMG  alpha¬ 
numeric  codes  discussed  above. 

The  biofeedback  study  we  have  just  reported  on  has  given  us  a 
good  deal  of  information  regarding  the  training  protocols  which  are  an 
essential  component  of  this  project.  The  results  of  the  biofeedback 
study  indicate  the  value  of  feedback  in  the  acquisition  of  the  task 
and  point  out  the  general  value  of  specific  feedback  information  on 
motor/conceptual  tasks.  We  now  seriously  question  the  necessity  for 
the  patterned  light  training  procedure  employed  heretofore.  Although 
we  cannot  be  certain  of  the  value  of  such  preliminary  training  without 
experimental  verification  it  appears  as  if  high  levels  of  subject 
performance  can  be  achieved  rapidly  without  such  pretraining.  The 
present  results  clearly  indicate  the  necessity  to  restructure  the 
EMG  alphanumeric  code  assignments.  We  propose  to  create  a  code  system 
which  takes  into  account  the  relative  letter  frequency,  information 
content  and  "error  quotient"  of  the  code.  Such  a  new  code  assignment 
should  reduce  error  signals  to  a  negligible  and,  thus,  acceptable 
level. 

II.  Sequential  Response  Support 

We  have  proceeded  with  the  software  support  necessary  to  implement 
the  sequential  responding  nature  of  the  project.  The  task  is  to 
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give  subjects  the  opportunity  to  "spell"  words  using  their  EMG  response 
apparatus.  The  words  will  be  "spelled"  either  in  response  to  alpha¬ 
numeric  display  (a  match-to-sample  task)  or  in  an  open-end  response 
mode  of  responding.  In  both  cases  the  subject  generated  code  will  be 
displayed  providing  immediate  visual  reinforcement.  In  one  case, 
visual/auditory  cueing,  the  subject  is  required  to  match-to-sample, 
and  is  a  form  of  machine -to-man  communication.  In  the  other  case, 
subject  initiated  words,  the  communication  takes  the  form  of  man-to- 
machine . 

There  are  several  rather  subtle  issues  to  bt  considered  at  this  ♦ 

point.  While  the  mere  training  of  subjects  to  "spell"  words  on  command 
or  by  initiation  may  seem  somewhat  simplistic,  consider  for  a  moment 
what  is  actually  occurring  and  how  it  differs  from  forms  of  motor  skill 
training. 

1)  We  are  having  subjects  encode  an  arbitrarily  defined  set  of 
responses.  We  have,  for  convenience  only,  assigned  alpha¬ 
numeric  values  to  these  sets  of  responses;  there  is  no 
intrinsic  reason  why  these  response  sets  could  not  just  as 
well  be  defined  es  functional  commands  to  control  man-machine 
systems . 

2)  We  are  dealing  with  16  or  32  response  patterns.  There  is  no 
intrinsic  reason  why,  using  these  procedures,  the  maximum 
number  of  unique  codes  could  not  be  expanded  to  312  or  1024. 

At  this  stage  of  understanding  it  is  more  fruitful  to  reduce 
complexity  rather  than  expand  complexity. 

3)  A  major  milestone  in  this  phase  will  be  the  development  of  a 
sequencing  algorithm  for  deciding  under  program  control  when 
to  advance  from  acquiring  R  codes  as  one  letter  or  command 

to  acquiring  these  R  codes  as  another  letter  or  command.  This 
is  a  significant  issue  in  that  subjects  do  not  generate  all 
responses  at  precisely  the  same  instant  in  time.  Hence,  some 
time  period  must  be  allowed  for  the  generation  of  all  responses 
necessary  for  a  particular  letter  or  code.  The  issue  to  be 
resolved  during  this  phase  is  whether  a  predefined  time  window 
or  "capture  timer"  is  sufficient  for  the  sequencing  at  this 
time,  or  i f  we  must  engage  in  mathematical  sequencing  algorithms 
similar  to  the  sequencing  in  linguistic  analysis. 

We  have  completed  the  development  of  the  software  support  for  the 
sequential  response  problem  (program  desigintion  =  res).  The  program 
has  been  tested  using  a  capture  time  of  250  msec  which  ensures  a  90-957., 
accuracy  in  well  trained  subjects.  We  are  currently  integrating  this 
system  with  e.  device  to  detect  small  concurrent  movements  of  the  respc  se 
associated  fingers.  This  latter  device  is  essentially  a  control  device 
which  will  feed  an  error  signal  or  null  into  the  computer.  This  system 
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will  perform  two  functions.  First,  it  will  form  the  basis  for  a  gross 
movement  error  detector  and  second,  it  will  provide  a  sensitive  means 
of  eliminating  the  tendency  to  respond  overtly.  Upon  integration  of  the 
sequential  response  program  and  the  movement  detector  we  will  decrease 
the  capture  times  window  to  determine  the  minimal  effective  sequential 
response  times. 
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Appendix  A 


Below  are  the  S  Codes  and  their  corresponding  alphanumer ics .  The 
codes  were  devised  with  the  following  considerations  in  mind.  First  it 
was  thought  to  be  desirable  to  give  the  most  commonly  occurring  alpha¬ 
betic  characters  the  simplest  code.  Thus,  the  letter  E  received  a  simple 
code:  the  right  brevis  alone.  Sirce  we  have  15  codes  to  issue  we 
determined  the  15  most  frequent  letters  and  tested  them  for  intelligi¬ 
bility.  The  15  letters  below  comprise  a  high  percentage  of  those  letters 
actually  used  in  normal  communication  and  can  convey  a  good  deal  of  infor 
mation . 

The  codes  are  given  octal  representation  merely  as  a  convenience. 


Alphabetic 

Character 

Left 

Minimi 

4 

Left  Right 

Brevis  Brevis 

3  2 

Right 

Minimi 

1 

Binary 

Code 

Octal 

Code 

E 

X 

0010 

02 

A 

X 

0100 

04 

I 

X 

0001 

01 

N 

X 

1000 

10 

0 

X 

X 

0110 

06 

R 

X 

X 

1100 

14 

S 

X 

X 

0011 

03 

T 

X 

X 

1001 

11 

L 

X 

X 

0101 

05 

C 

X 

X 

1010 

12 

U 

X 

X 

X 

0111 

07 

P 

X 

X 

X 

1011 

13 

M 

X 

X 

X 

1101 

15 

H 

X 

X 

X 

10 

16 

D 

X 

X 

V 

X 

l  1 

17  _ 

The  Xs  indicate 

which 

of  the 

lamps  are 

to  be  lit 

for  a  g 

ven  alpha 

betic  character. 
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APPENDIX  B 


ARPA  Instructions  to  Subjects 


This  is  a  study  of  human  performance.  We  are  interested  in  ways  to 
improve  human  performance.  You  wi’l  be  given  various  signals,  each  of  which 
rails  for  a  specific  response  from  you.  You  will  make  many  wrong  responses 
at  first,  but  your  performance  will  improve  with  the  number  of  trials.  Don't 

worry  about  making  a  wrong  response  -  they  are  useful  to  us  too,  but  try  your 
best  to  make  the  right  one. 

The  signal  will  consist  of  a  pattern  of  lights  which  ire  arranged  in  a 
horizontal  row.  There  is  a  total  of  lour  lights,  and  the  pattern  may  consist’ 
of  any  combination  of  lights  from  "all  off"  to  "all  on". 

Your  response  will  consist  of  a  movement  of  your  thumbs  and  4th  fingers 
on  both  hands  either  one  at  a  time  or  in  various  combinations.  This  movement 
causes  a  change  in  the  electrical  potential  of  the  activated  muscle.  We  can 
monitor  and  record  this  change  of  potential  as  an  electromyogram  (EMG) .  This 
is  done  by  placing  a  surface  electrode  on  the  skin  immediately  overlying  the 
activated  muscle.  (This  involves  no  pins  or  clamps  --  the  electrode  merely 
lies  flat  on  the  skin).  There  is  no  shock  involved.  With  this  electrode  system 
™  reC°rd  -  nQt  Simulate.  When  you  make  a  response,  we  will  monito, 

the  EMG  only  --  we  are  not  interested  in  the  actual,  overt  movement.  It  you 
can  generate  a  potential  of  adequate  magnitude  without  a  large  amount  of 
movement  --  by  all  means,  do  so. 

Assj8nment  °f  Fingers  and  Lights.  Basically,  the  experiment  works  like 
this:  When  one  or  more  of  the  four  top,  yellow,  lights  is  lit,  it  ii  a  signal  for 

you  to  move  the  muscle  which  has  been  assigned  to  that  light.  The  assignments 
are  as  follows  : 


Left  Little 


Left  Thumb 


Right  Thumb 


Place  your  open  hands  palms  down  on  th  ar  -ests  of  the  chair, 
muscles  ar°  in  the  same  sequence  horizontally. 


The  light.!  and 


As  different  combinations  of  lights  flash  on,  try  to  match  them  with  the 
appropriate  combination  of  movements.  Your  response  should  come  as  soon  as 
possibie  after  the  lights  appear.  A  new  tr<al  will  be  given  every  6-10  seconds, 
and  there  wil  be  a  rotal  of  256  trials  per  day.  A  run  will  last  about  one  hour. 
(Errors):  You  can  make  two  typ* s  of  errors  in  your  response:  1)  you  can  fai.  to 
match  with  an  EMG  a  light  which  is  lit;  2)  you  can  make  a  muscle-response  wh-'ch  is 
not  called  for  --  that  is,  the  corresponding  light  is  not  lit. 

1,1  both  cases  you  will  fail  to  see  the  square  red  light  on  the  right  side  of 
the  panel  light  up.  This  light  is  only  turned  on  by  a  correct  response.  When 
you  see  it  lit  up  after  a  trial,  you  know  that  you  have  made  the  desired  response. 
r.lease  t_ry  to  get  accuracy  first ,  and  speed  second . 
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Figure  1 
Figure  2 

Figure  3 

Table  1 

Table  2 

Table  3 

Table  A 

Table  5 

Table  6 

Table  7 

Tal le  8 

Table  9 


Physical  arrangement  of  the  training  facilities. 


Representation  of  the  interactive  display  devices.  The  subject 
is  seated  one  meter  in  front  of  the  devices. 


The  probability  of  generating 
condition  (light  training  or 
feedback,  and  days. 


an  error,  as  a  function  of  training 
letter  training),  feedback  or  non- 


Condit Iona  1  probability  of  error  -  Measure  A.  Raw  data  expressed 
for  all  treatments  end  days. 


Binary  Code  to  EMG  response . 


Ranking  of  conditional  vrobability  of  error  -  Measure  A.  Light 
training  as  a  function  of  feedback/non -feedback  and  days. 


Ranking  of  conditional  probability  of  error  -  Measure  A.  Letter 
training  as  a  function  of  feedback/non -feedback  and  days. 


Ranking  of  conditional  probability  of  orror  -  Measure  A.  Light 

and  letter  training  for  feedback/non-feedback  collapsed  across 
days . 


Conditional  probability  of  error  -  Measure  B.  Raw  data  expressed 
for  all  treatments  and  days* 


Ranking  of  conditional  probability  of  error  -  Measure  B.  light 
training  as  a  function  of  feedback/non-feedback  days. 


Racing  of  conditional  probability  of  error  -  Measure  B.  Letter 
training  as  a  function  of  feedback/non -feedback  and  days. 


Ranking  of  conditional  probability  of  emr  -  Measure  B.  Light 
and  letter  training  for  feedback/non-feedb. ck  iollapsed  across 
days. 
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LAMP'DISPLAY 


PHYSICAL  ARRANGBBff  OF  TRAINING  FACILITIES 


INTERACTIVE  DISPLAY  DEVICES 


reinforcement  lamp 


alphanumeric  display 


BIOFEEDBACK  -  CONDITIONAL  PROBABILITY  OF  ERROR  -  MEASURE 


TABLE  2 


BINARY  CODE  TO  EMG 


Binary  Code  = 


0  0 


Obductor 

Digiti 

Minimi 

(Little  Finger) 


Flexor 
Pol  Ileus 
Brevis 


Pollicus  Digiti 

Brevis  Minimi 

(Little  Finger) 


(Thumb) 


(Thumb) 


TABLE  3 


Least 

Errors 

A 


V 

Most 

Errors 


RANKING  OF  CONDITIONAL  PROBABILITY  OF  ERROR  -  MEASURE  A 

LIGHT  TRAINING 


Day  1 


F 

NF 

(BL)OOOO 

(BL)OOOO 

(D) 1111 

(D) 1111 

(R) 1100 

(M 1000 

(S)0011 

(R) 1100 

(N) 1000 

(S)0011 

(U)0111 

(0)0110 

(0)0110 

(E)0010 

(H) 1110 

(0)0111 

(E)0010 

(T; 1001 

(A)0100 

(H) 1110 

(1)0001 

(A)  0100 

(L)C101 

(C)1010 

(T)1001 

(P)1011 

(P)1011 

(L)0101 

(C)1010 

(M)  1101 

ao  hoi 

(1)0001 

Day  2 


F 

NF 

(D) 1111 

(BL)OOOO 

(H) 1110 

(R) 1100 

(M)0111 

(S)0011 

(T)1001 

(D) 1111 

(R) 1100 

(T) 1001 

(N) 1000 

(N) 1000 

(BL)OOOO 

(H)1110 

(1)0001 

(A)  0100 

(E)0010 

(M)1101 

(A)0100 

(U)0111 

(L)0101 

(E)0010 

(0)0110 

(L)0101 

(S)0011 

(0)0110 

(C)1010 

(P) 1011 

(M) 1101 

(C)1010 

(P) 1011 

(1)0001 

Day  3 


F 

NF 

(D) 1111 

(BDOO^O 

(BL)OOOO 

(R)  1100 

(S)0011 

(A)0100 

(U)Oill 

(C)1010 

(0)0110 

(D) 1111 

(N) 1000 

(T)1001 

(T)lOOi 

OU)0111 

(R)  1100 

(P)1011 

(C)1010 

(0)0110 

(E)0010 

0  )iooo 

(L)0101 

(H) 1110 

(A)OiOO 

(E)0010 

(1)0001 

(M) 1101 

(P) 1011 

(L)0101 

(M) 1101 

(S)0011 

(H) 1110 

(1)0001 

Day  4  r 


F 

*  NF 

(D) 1111 

(N) 1000 

(H) 1110 

(BL)OOOO 

(S)0011 

(E)0010 

(P)1011 

(R) 1100 

(0)0110 

(S)0011 

(BL)OOOO 

(T) 1001 

(N) 1000 

(1)0001 

(T) 1001 

(A)0100 

(R)1100 

(U)0111 

(C)1010 

(D) 1111 

(E)0010 

(L)0101 

(U)0111 

(0)0110 

(A)0100 

(P)1011 

(M)1101 

(C)1010 

(L)0101 

(H) 1110 

(1)0001 

(M) 1101 

/? 


RANKING  OF  CONDITIONAL  PROBABILITY  OF  ERROR  -  MEASURE  A 


Least 

Errors 

A 


V 

Most 

Errors 


LETTER  TRAINING 


Day  1 


F 

NF 

(BL)OOOO 

(BL)OOOO 

(A) 0100 

(D) 1111 

(D) 1111 

(1)0001 

(S)0011 

(N) 1000 

(U)0111 

(A)  0100 

(R) 1100 

(R) 1100 

(E)0010 

(S)0011 

(0)0110 

(T) 1001 

(1)0001 

(L)0101 

(C)1010 

(E)0010 

(H) 1110 

(0)0110 

(N) 1000 

(U)0111 

(T) 1001 

(H) 1110 

(L) 0101 

(C)1010 

(P)1011 

(P)1011 

(M) 1101 

(M) 1101 

Day  2 


F 

NF 

(D) 1111 

(BL)OOOO 

(BL)OOOO 

(D) 1111 

(S)0011 

(S)0011 

(1)0001 

(R)1100 

(U)0111 

(A)0100 

(T) 1001 

(E)0010 

(0)0110 

(N) 1000 

(N) 1000 

(1)0001 

(R) 1100 

(L)0101 

(L)0101 

(C)1010 

(C)1010 

(M) 1101 

(E)0010 

<,0)0110 

(A)0100 

(T) 1001 

(H) 1110 

(U)0111 

(P)1011 

(P) 1011 

(M) 1101 

(H)1110 

I 


Day  3 


F 

NF 

(R)1100 

(BL) 0000 

(BL)OOOO 

(D) 1111 

(E)0010 

(S)0011 

(D)llll 

(R)1100 

(N) 1000 

(0)0110 

(1)0001 

(1)0001 

(A)0100 

(E) 0010 

(T) 1001 

(N) 1000 

(S)0011 

(T) 1001 

(L)0101 

(L) 0101 

(C)1010 

(A) 0100 

(U)0111 

(H) 1110 

(0)0110 

(U)0111 

(H) 1110 

(M) 1101 

(P) 1011 

(C)1010 

(M)1 101 

(P)1C11 

Day  A 


F 

NF 

(BL)OOOC 

(BL)OOOO 

(D) 11 11 

(S)0011 

(U)0111 

(1)0001 

'T) 1001 

(D) 111 i 

(S)0011 

(E)0010 

(1)0001 

(N) 1000 

(H) 1110 

(R)  1100 

(E)0010 

(L)0101 

(N) 1000 

(H) 1110 

('0 1100 

(0)0110 

(L)0101 

(T) 1001 

(A)010C 

(U)0111 

(0)0110 

/^s 

n 

V.' 

O 
►— » 
o 

(C)1010 

(A)0100 

(P)1011 

(M) 1101 

(M)1101 

(P)1011 

C 


TABLE 


5 


Least 

Errors 

* 


Most 

Errors 


tlANKING  OF  CONDITIONAL  PROBABILITY  OF  ERROR  -  MEASURE  A 

ACROSS  DAYS 


Light  Training 


F 

NF 

(D) 1111 

(BL)OOOO 

(BL)OOOO 

(R)  1100 

(N) 1000 

(N) 1000 

(S)0011 

(D) 1111 

(U)0111 

(T) 1001 

(R)  1100 

(A)0100 

(0)0110 

(E)OO' 0 

(H) 1110 

(U)0111 

(T) 1001 

(0)0110 

(A)0100 

(H) 1110 

(E)0010 

(P)10U 

(C)1010 

(S)0011 

(L)0101 

(C)1010 

(P) 1011 

(L)0101 

(1)0001 

(1)0001 

(M) 1101 

(M) 1101 

Letter  Training 


F 

NF 

(BL)OOOO 

(BL)OOOO 

(D) 1111 

(D) 1111 

(S)0011 

(R)1100 

(R) 1100 

(1)0001 

(1)0001 

(N) 1000 

(E)0010 

(E)0010 

(N) 1000 

(A)0100 

(U)0111 

(L)0101 

(T) 1001 

(0)0110 

(A)0100 

(T) 1001 

(0)0110 

(H) 1110 

(L)0101 

(C)1010 

(C)1010 

(U)0111 

(H) 1110 

(M) 1101 

(P) 1011 

(P)1011 

(M) 1101 

(S)0011 

Jl 


PROBABILITY 


4J 

• 

• 

• 

• 

• 

• 

• 

• 

• 

. 

<D 

i-4 

<0 

Q 

Pm 

0C0‘ 

o 

o 

<r 

O 

.206 

.030 

H 

O 

o 

CN 

o 

.017 

.051 

.030 

O' 

o 

00 

00 

o 

.071 

<r 

r-» 

O 

.030 

00 

o 

CO 

uo 

H 

CO 

Pm 

H 

O 

CO 

O'* 

O'  <3 

CM 

CO 

TABLE  7 


Least 

Common 

A 


V 

Most 

Common 


RANKING  OF  PROBABILITY  OF  ERROR  -  MEASURE  B 

LIGHT  TRAINING 


Day  1 


F 

NF 

(1)0001 

(E)0010 

(L)0101 

(L)0101 

(BL)OOOO 

(1)0001 

(A)0100 

(A) 0100 

(T) 1001 

(M) 1101 

(N) 1000 

(T) 1001 

(R) 1100 

(P)1011 

(E)0010 

(C)1010 

(C)101C 

(BL)OOOO 

(M) 1101 

(N) 1000 

(P)1011 

(S)0011 

(S)0011 

(U)0111 

(0)0110 

(0)0110 

(H) 1110 

(R) 1100 

(U)0111 

(H) 11 10 

(D) 1111 

(D) 1111 

Day  2 


F 

NF 

(N) 1000 

(1)0001 

(E)0010 

(L) 0101 

(BL)OOOO 

(BL)OOOO 

(A)0100 

(C)IOIO 

(C)IOIO 

(E)0010 

(0)0110 

(A)0100 

(1)0001 

(0)0110 

(L)0101 

(T) 1001 

(R) 1100 

(P)1011 

(T) 1001 

(N) 1000 

(S)0011 

(U)0111 

(r)  ion 

(S)0011 

(M) 1101 

(M) 1101 

(H) 1110 

(H)lllO 

(U)0111 

(R)1100 

(D) 1111 

(D)llll 

Day  3 


F 

NF 

(D) 1111 

(1)0001 

(S)0011 

(L)0101 

(U)0111 

(BL)OOOO 

(BL)OOOO 

(A)0100 

(N) 1000 

(M) 1101 

(0)0110 

(E)0010 

(T) 1001 

(C)IOIO 

(R) 1100 

(N) 1000 

(E)0010 

(0)0110 

(C)IOIO 

(R)1100 

(L)0101 

(H) 1110 

(1)0001 

(T) 1001 

(A)0100 

(S)0011 

(P)1011 

(U)0111 

(M) 1 101 

(P)1011 

(H) 1110 

(D) 1111 

Day  A 


F 

NF 

(A) 0100 

(T) 1001 

(E)0010 

(L)0101 

(0)0110 

(N) 1000 

(BL)OOOO 

(C)1010 

(C)1010 

(BL)OOOO 

(1)0001 

(M) 1101 

(T) 1001 

(1)0001 

(L)0101 

(A)0100 

(M) 1101 

(R) 1100 

(N) 1000 

(P)1011 

(P)1011 

(H) 1110 

(R) 1100 

(E)0010 

(H) 1110 

(S)0011 

(U)0111 

(U)0111 

(S)0011 

(0)0110 

(D) 1111 

(D) 1111 

TABLE  8 


RANKING  OF  PROBABILITY  OF  ERROR  -  MEASURE  B 

LETTER  TRAINING 

t 


Least 

Common 


Most 

Common 


Day 

1 

F 

NF 

(1)0001 

(1)0001 

(A)OIOO 

(C)1010 

(P) 1011 

(L) 0101 

(N) 1000 

(T) 1001 

(L)0101 

(A) 0100 

(S)0011 

(E) 0010 

(M) 1101 

(N) 1000 

(R)1100 

(S)0011 

(E)0010 

(R) 1100 

(T) 1001 

(P)1011 

(0)0110 

(0)0110 

(U)0111 

(M) 1101 

(C)1010 

(U)Olll 

(H) 1110 

(H) 1110 

(BL)OOOO 

(D) 1111 

(D) 1111 

(BL)OOOO 

Day  2 


F 

NF 

(A)0100 

(C)1010 

(L)0101 

(1)0001 

(1)0001 

(A)  0100 

(T)100i 

(N) 1000 

(N) 1000 

(T)1001 

(E)0010 

(E)0010 

(IL)OOOO 

(L)0101 

(M) 1101 

(BL) 0000 

(R) 1100 

(S)OOU 

(S)0011 

(0)0110 

(C)1010 

(U)0111 

(U)0111 

(P)1011 

(P)1011 

(R)  1100 

(0)0110 

(H) 1110 

(H)1110 

(M) 1 101 

(D) 1111 

(D) 1111 

Day 

3 

F 

NF 

(BL)OOOO 

(A)0100 

(T) 1001 

(L)0.01 

(N) 1000 

(T) 1001 

(1)0001 

(E)0010 

(A)0100 

(C)1010 

(H) 1110 

(1)0001 

(L)0101 

(U)0111 

(U)0111 

(N) 1000 

(C)1010 

(S)0011 

(M) 1101 

(BL)OOOO 

(0)0110 

(P) 1011 

(R) 1100 

(0)0110 

(S)0011 

(R)1100 

(E)0010 

(M) 1101 

(P)1011 

(H) 1110 

(D) 1111 

(D) 1111 

Day  A 


F 

NF 

(BL) 0000 

(T) 1001 

(a) 0100 

(C)IOIO 

(T) 1001 

(1)0001 

(1)0001 

(A)0100 

(N) 1000 

(L)0101 

(U)0111 

(M) 1101 

(L)0101 

(N) 1000 

(E) 0010 

(BL)OOOO 

(0)0110 

(R)  1100 

(R)1100 

(E)0010 

(H) 1110 

(P) 1011 

(M) 1101 

(0)0110 

(P)1011 

(S)0011 

(C)IOIO 

(H) 1110 

(S)0011 

(U)0111 

(D) 1111 

(D)llll 

TABLE  9 


RANKING  OF  CONDITIONAL  PROBABILITY  OF  ERROR  -  MEASURE  B 


ACROSS  DAYS 


Least 

Common 


Host 

Common 


Light  Training 


F 

NF 

ifc' )0000 

(1)0001 

(N) 1000 

(L) 0101 

(E)0010 

(BL)OOOO 

(A)  0100 

(A)0100 

(1)0001 

(C)1010 

(T) 1001 

(E)0010 

(L) 0101 

(T)1001 

(C) 1010 

(M) 1101 

(0)0110 

(N) 1000 

(R) 1100 

'P)1011 

(S)001i 

(0)0110 

(M) 1101 

(R)1100 

(P)1011 

(H) 1110 

(H) 1110 

(S)0011 

(U) 01 11 

(U)0111 

(D) 1111 

(D) 1111 

Letter  Training 


F 

NF 

(A)  0100 

(C)1010 

(1)0001 

(T) 1001 

(N) 1000 

(A) 0100 

(L)0101 

(1)0001 

(T)  ,001 

(L)0101 

(BL)OOOO 

(E) 0010 

(M) 1101 

(N) 1000 

(R)1100 

(S)0011 

(U)0111 

(R)1100 

(E)u010 

(0)0110 

(0)0110 

(P)1011 

(C)1010 

(BL)OOOO 

(H) 1110 

(M) 1101 

(S)0011 

(U)0111  . 

(i  non 

(H) 1110 

(D) 1  ill 

(D) 1 11 1 

2s* 


